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ABSTRACT: Observing how long a dynamical system takes to return to some state 
is one of the most simple ways to model and quantify its dynamics from data series. 
This work proposes two formulas to estimate the KS entropy and a lower bound of it, a 
sort of Shannon's entropy per unit of time, from the recurrence times of chaotic systems. 
One formula provides the KS entropy and is more theoretically oriented since one has to 
measure also the low probable very long returns. The other provides a lower bound for the 
KS entropy and is more experimentally oriented since one has to measure only the high 
probable short returns. These formulas are a consequence of the fact that the series of 
returns do contain the same information of the trajectory that generated it. That suggests 
that recurrence times might be valuable when making models of complex systems. 



1. Introduction 

Recurrence times measure the time interval a system takes to return to a neighborhood 
of some state, being that it was previously in some other state. Among the many ways time 
recurrences can be defined, two approaches that have recently attracted much attention 
are the first Poincare recurrence times (FPRs) [ [1] and the recurrence plots (RPs) [ [2] . 

While Poincare recurrences refer to the sequence of time intervals between two suc- 
cessive visits of a trajectory (or a signal) to one particular interval (or a volume if the 
trajectory is high dimensional), a recurrence plot refers to a visualization of the values 
of a square array which indicates how much time it takes for two points in a trajectory 
with M points to become neighbors again. Both techniques provide similar results but 
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are more appropriately applicable in different contexts. While the FPRs are more appro- 
priated to obtain exact dynamical quantities (Lyapunov exponents, dimensions, and the 
correlation function) of dynamical systems [[3], the RPs are more oriented to estimate 
relevant quantities and statistical characteristics of data coming from complex systems [ 



The main argument in order to use recurrence times to model complex systems [ [5] 
is that one can easily have experimental access to them. In order to know if a model 
can be constructed from the recurrence times, it is essential that at least the series of 
return times contains the same amount of information generated by the complex system, 
information being quantified by the entropy. 

Entropy is an old thermodynamic concept and refers to the disorganized energy that 
cannot be converted into work. It was first mathematically quantified by Boltzmann in 
1877 as the logarithm of the number of microstates that a gas occupies. More recently, 
Shannon [ [6] proposed a more general way to measure entropy H$ in terms of the proba- 
bilities pi of all possible i states of a system: 



Applied to non-periodic continuous trajectories, e.g. chaotic trajectories, Hs is an 
infinite quantity due to the infinitely many states obtained by partitioning the phase 
space in arbitrarily small sites. Therefore, for such cases it is only meaningful to measure 
entropy relative to another trajectory. In addition, once a dynamical system evolves with 
time, it is always useful for comparison reasons to measure its entropy production per 
unit of time. 

Such an ideal entropy definition for a dynamical system was introduced by Kolmogorov 
in 1958 [[7J and reformulated by Sinai in 1959. It is known as the Kolmogorov-Sinai (KS) 
entropy, denoted by H KS , basically the Shannon's entropy of the set per unit of time [ 
[S] , and it is the most successful invariant quantity that characterize a dynamical system [ 
[9]. However, the calculation of the KS entropy to systems that might possess an infinite 
number of states is a difficult task, if not impossible. For a smooth chaotic system [ [10] 
(typically happens for dissipative systems that present an attractor), Pesin [[11] proved 
an equality between H KS and the sum of all the positive Lyapunov exponents. However, 
Lyapunov exponents are difficult or even impossible to be calculated in systems whose 
equations of motion are unknown. Therefore, when treating data coming from complex 
systems, one should use alternative ways to calculate the KS entropy, instead of applying 
Pesin's equality. 

Methods to estimate the correlation entropy, K 2 , a lower bound of H KS , and to calculate 
Hks from time series were proposed in Refs. [32]. In Ref. [d2] K 2 is estimated from 
the correlation decay and in Ref. [ [13] by the determination of a generating partition 
of phase space that preserves the value of the entropy. But while the method in Ref. | 
[12] unavoidably suffers from the same difficulties found in the proper calculation of the 
fractal dimensions from data sets, the method in Ref. [ d3] requires the knowledge of the 
generating partitions, information that is not trivial to be extracted from complex data 
[ I14j. In addition, these two methods and similar others as the one in Ref. [[15] require 
the knowledge of a trajectory. Our work is devoted to systems whose trajectory cannot 
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be measured. 

A convenient way of determining all the relevant states of a system and their proba- 
bilities (independently whether such a system is chaotic) is provided by the FPRs and 
the RPs. In particular to the Shannon's entropy, in Refs. [ HH [T71 [181 H] ways were 
suggested to estimate it from the RPs. In Refs. [ [161 EH H] a subset of all the possible 
probabilities of states, the probabilities related to the level of coherence/correlation of 
the system, were considered in Eq. (TTJ). Therefore, as pointed out in Ref. [ 18J, the 
obtained entropic quantity does not quantify the level of disorganization of the system. 
Remind that unavoidably Shannon's entropy calculated from RPs or FPRs depends on 
the resolution with which the returns are measured. 

The main result of this contribution is to show how to easily estimate the KS-entropy 
from return times, without the knowledge of a trajectory. We depart from similar ideas 
as in Refs. [ [TBI E0 ESI S] and show that the KS entropy is the Shannon entropy [in Eq. 
([T])] calculated considering the probabilities of all the return times observed divided by 
the length of the shortest return measured. This result is corroborated with simulations 
on the logistic map, the Henon map, and coupled maps. We also show how to estimate 
a lower bound for the KS entropy using for that the returns with the shortest lengths 
(the most probable returns), an approach oriented to the use of our ideas in experimental 
data. Finally, we discuss in more details the intuitive idea of Lettelier [ ITS] to calculate 
the Shannon's entropy from a RP and show the relation between Letellier's result and the 
KS entropy. 

2. Estimating the KS entropy from time returns 

Let us start with some definitions. By measuring two subsequent returns to a region, 
one obtains a series of time intervals (FPRs) denoted by n (with i = 1,...,N). The 
characterization of the FPRs is done by the probability distribution p(r,B) of Tj, where 
B represents the volume within which the FPRs are observed. In this work, B is a D- 
dimensional box, with sides Si, and D is the phase space dimension of the system being 
considered. We denote the shortest return to the region B as r min (B). 

Given a trajectory {xi}iz 1; the recurrence plot is a two-dimensional graph that helps 
the visualization of a square array Rif 

Rij = e(€ 2 -||x,-x j ||) (2) 

where €2 is a predefined threshold and 9 is the Heaviside function [[2]. In the coordinate 
of the RP one plots a black point if Rij = 1, and a white point otherwise. 
There are many interesting ways to characterize a RP, all of them related to the lengths 
(and their probabilities of occurrence) of the diagonal, horizontal, and vertical segments 
of recurrent points (black points) and of nonrecurrent points (white points). Differently 
from Ref. [[18] where it was used the nonrecurrent diagonal segments, we consider here 
the vertical nonrecurrent and recurrent segments because they provide a direct link to the 
FPRs [US]. 

Given a column i, a vertical segment of Q white points starting at j = p and ending at 
j — p + Q — 1, indicates that a trajectory previously in the neighborhood of the point Xj 
returns to it firstly after Q + 1 iterations in the neighborhood of the point Xj, basically 
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the same definition as the FPR to a volume centered at Xj. However, the white points 
represent returns to the neighborhood of Xj which are larger than 1. In order to obtain 
the returns of length 1, one needs to use the recurrent segments, the segments formed by 
black points. A recurrent vertical segment at the column i, starting at j — p and ending 
at j = p + Q, means that it occurred Q first returns of length 1 to the neighborhood of the 
point Xj. The probability density of the return times observed in the RP is represented 
also by p(r, B) . It is constructed considering the first returns observed in all columns of 
the RP and it satisfies J p(r, B)dr = 1. 

Notice that the Shannon's entropy of first returns of non-periodic continuous systems 
becomes infinite [[20] as the size e of the volume B approaches zero. For chaotic systems 
(as well as for stochastic systems) the reason lies on the fact that the probability density 
p(r,B) approaches the exponential form fie - ' 17 ' [[21], where /i is the probability of finding 
the trajectory within the volume B. 

Placing in Eq. ([I]) the probabilities of returns p(r, £>), we can write that H KS = H s /T, 
where T is some characteristic time of the returns [[8] that depends on how the returns are 
measured. For the FPRs there exists three characteristic times: the shortest, the longest 
and the average return. The quantity T cannot be the longest return since it is infinite. 
It cannot be the average return, since one would arrive to H^s — yulogG^) which equals 
zero as e — > 0. Therefore, T = T min is the only remaining reasonable characteristic time 
to be used which lead us to 

M£| ^dw?^' e|£|)log (^k))- (3) 

For uniformly hyperbolic chaotic systems (tent map, for example), we can prove the 
validity of Eq. ([3]). From Ref. [[26] we have that 

Hks = ~ lim — \og(p(r min , B[e\)) (4) 

a result derived from the fact that the KS entropy exponentially increases with the number 
of unstable periodic orbits embedded in the chaotic attractor. Since p(r, e) — > fie - ' 17 ' 
as e — > 0, assuming r min to be very large, and noticing that J — /xe _/XT Zop[/xe _/ir ](ir = 
— log[fi] + 1, assuming that r min — > oo and noticing that for such systems fi[B] = p(r min , e), 
we finally arrive that 

— log [p{r m m)\ = — Yl ^( r ) lo S t^( r )] ( 5 ) 

r 

and therefore, the right-hand side of Eq. ([3]) indeed reflects the KS entropy. But notice 
that Eq. ([3]) is being applied not only to non-uniformly hyperbolic systems (Logistic and 
Henon maps) but also to higher dimensional systems (two coupled maps). 

This result can also be derived from Ref. [ [2T] where it was shown that the positive 
Lyapunov exponent A in hyperbolic ID maps is 

A = UmZ /o^ 

T min (B[e\) 
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Since p(r, e) — > fie MT as e — > 0, and using that A = P^s (Pesin's equality), and finally 
noticing that J — u.e~^ T log[u.e~^ T ]dT = —log\p] + 1, one can arrive to the conclusion that 
T = r min in Eq. ©. 

The quantity in Eq. is a local estimation of the KS entropy. To make a global 
estimation we can define the average 

B(e) 

representing an average of Hks[^( € )] calculated considering L different regions in phase 
space. 

In order to estimate the KS entropy in terms of the probabilities obtained from the 
RPs, one should use T = (r min ), i.e., replace r min in Eq. (J3} by (r min ), where (r min ) = 
~h J2i T min(i), the average value of the shortest return observed in every column of the RP. 
The reason to work with an average value instead of using the shortest return considering 
all columns of the RP is that every vertical column in the RP defines a shortest return 
Tminii) (i = 1, . . . ,M), and it is to expect that there is a nontypical point i for which 

Imagining that the RP is constructed considering arbitrarily small regions (e2 — > 0) 
and that we could treat an arbitrarily long data set, the column of the RP which would 
produce r min = 1 would be just one out of infinite others which produce r min » 1. There 
would be also a finite number of columns which would produce r min of the order of one 
(but larger than one), but also those could be neglect when estimating the KS-entropy 
from the RPs. The point we want to make in here is that the possible existence of many 
columns for which one has T min = 1 are a consequence of the finite resolution with which 
one constructs a RP. In order to minimize such effect in our calculation we just ignore 
the fact that we have indeed found in the RP r m j n = 1, and we consider as r min any 
return time longer than 1 as the minimal return time. In fact, neglecting the existence 
of returns of length one is a major point in the work of Ref. [ [T5], since there only the 
nonrecurrent diagonal segments are considered [dH], and thus, the probability of having 
a point returning to its neighborhood after one iteration is zero. 

From the conditional probabilities of returns, a lower bound for the KS entropy can be 
estimated in terms of the FPRs and RPs by 

u /miw if 1 p{n + Pt) , 
HK S (B[ t ])>--Y i p- 1 ^ r lo S 

where we consider only the returns r» for which p{ji + Pj)/ ' p{ji) > and r» + Pj < 2r min , 
with Pi E M. 

The derivation of Eq. is not trivial because it requires the use of a series of concepts 
and quantities from the Ergodic Theory. In the following, we describe the main steps to 
arrive at this inequality. 

First we need to understand the way the KS-entropy is calculated via a spatial integra- 
tion. In short, the KS-entropy is calculated using the Shannon's entropy of the conditional 
probabilities of trajectories within the partitions of the phase space as one iterates the 
chaotic system backward [[2]. More rigorously, denote a phase space partition 5n- By a 



p(Tj + P) 
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Figure 1. [color online] Results from Eq. ([3]) and (EJ). The probability function p(r,B) of 
the FPRs (RPs) were obtained from a series of 500.000 FPRs (from a trajectory of length 
15.000 points). The brown line represents the values of the positive Lyapunov exponent. 
In (A) we show results for the Logistic map as we vary the parameter c, e<i = 0.002 for the 
brown stars and ei=0.001 for the green diamonds. In (B) we show results for the Henon 
map as we vary the parameter a for 6=0.3, = [0.002 — 0.03] for the brown stars and 
t\ =0.002 for all the other results, and in (C) results for the coupled maps as we vary the 
coupling strength a, e2=0.05 for the brown stars and ei=0.02 for green diamonds. 



partition we refer to a space volume but that is defined in terms of Markov partitions. 
Denote S as S = S fl Si fl Sk-i where Sj G F'^Sn (j = 0, . . . , k — 1), where F is a chaotic 
transformation. Define h N (k) = ^n^^ log ^jr|y^ and [i(S) represents the probability 

measure of the set S. The KS-entropy is defined as Hks = limj->oo f Y^!k=o I p{dx)hN{k), 
where the summation is taken over I iterations. 

Assume now that the region B represents the good partition Sn- The region Sj is the 
result of F~^5n, i.e., a j-th backward iteration of B. So, clearly, if one applies j forward 
iterations to Sj, then F^ Sj — > B. The quantities fi(SnSk) and refer to the measure of 
the chaotic attractor inside S fl Sk and S, respectivelly. By measure we mean the natural 
measure, i.e. the frequency with which a typical trajectory visits a region. /x(S fl S&) 
refers to the measure that remained in B after k iterations and fi(S) the measure that 
remained in B after k — 1 iterations. 

For k — > oo, we have that — > ^{B). Also for finite values of k, one has that 

ij!(W) ~ M^O- For any finite k, we can split this fraction into two components: ^pr^ = 
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HREc(k, B)+u. NR (k, B). Hrec refers to the measure in B associated with unstable periodic 
orbits (UPOs) that return to B, after k iteration of F, at least twice or more times, unr 
refers to the measure in B associated with UPOs that return to B only once. 

As it is shown in Ref. [[26], p{r,B) = fiN R (T,B), which in other words means that 
the probability density of the FPRs in B is given by fiN R (k,B). But, notice that for 
t < 2T min , fi RE c(k,B) = since only returns associated with UPOs that return once can 
be observed inside B } and therefore p(r, B) = , if t < 2r min . Consequently, we have 

that ^fgp = since ^ = P (r, B) and g| = p(r - 1, B). 

The remaining calculations to arrive in Eq. (jSJ) consider the measure of the region S T R 
S T +p (instead of S(~)S T ) in order to have a positive condition probability, i.e. / ^ S ^f r ) +i ^ > 
0, with n(S T ) representing the measure of the trajectories that return to B after r iterations 
and fi(S T fl S T+ p) the measure of the trajectories that return to B after r + P iterations. 
The inequality in Eq. (jSJ) comes from the fact that one neglects the infinitely many terms 
coming from the measure Prec{ t , B) that would contribute positively to this summation. 

3. Estimation of errors in H KS and (H KS ) 

In order to derive Eq. (|3j), we have assumed that f —iie~ liT log\iie~ ilT \dT = — log [pt] + 1, 
which is only true when r min =0. In reality, for r min > 0, we have f 00 —ue~ llT log\iie~^ T ]dT 

J T min 

= e~^ Tmin [pT min — log/i] + 1, but as e tends to zero fiT min — > and therefore, as assumed 
/ -fie~^ T log[fie~^ T ]dT ~ - log [u] + 1. 

Making the same assumptions as before that p(r, e) — > jie~^ T as e — * 0, and using Eq. 
(El), then Eq. ([3]) can be written as 

H KS (B[e])*>\+ 1 (9) 
r miri (o[eJJ 

Theoretically, one can always imagine a region e with an arbitrarily small size, which 
would then make the term — — to approach zero. But, in practice, for the considered 
values of e, we might have (for atypical intervals) shortest returns as low as r m j n = 4. As 
a result, we expect that numerical calculations of the quantity in Eq. ([3D would lead us 
to a value larger than the positive Lyapunov exponent, as estimated from the returns of 
the trajectory to a particular region. 

Naturally, would provide a local deviation of the quantity in Eq. (E2) with respect 
to the KS entropy. To have a global estimation of the error we are making by estimating 
the KS entropy, we should consider the error in the average quantity (Hks) which is given 
by 

e = ^^JbW) (10) 

where the average is taken over L different regions in phase space, and thus for chaotic 
systems with no more than one positive Lyapunov exponent 



(H KS ) w A + E 



(11) 
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Figure 2. [color online] Results from Eq. (JSj) . The probability function p(r,B) of the 
FPRs (RPs) were obtained from a series of 500.000 FPRs (from a trajectory of length 
15.000 points). The brown line represents the values of the positive Lyapunov exponent. 
In (A) we show results for the Logistic map as we vary the parameter c, 62 = 0.002 for 
the black circles and ei=0.001 for the red squares. In (B) we show results for the Henon 
map as we vary the parameter a for 6=0.3, €2 = [0.002 — 0.03] for the black circles and 
ei =0.002 for the red squares, and in (C) results for the coupled maps as we vary the 
coupling strength a, e2=0.05 for the black circles and ei=0.02 the red squares. 



To generalize this result to higher dimensional systems, we make the same assumptions 
as the ones to arrive to Eq. but now we use Eq. ([5]). We arrive that 



(12) 



where H denotes the exact value of the KS entropy. 

Finally, it is clear from Eq. (|T2l that (HKs(B[e\)) is an upper bound for the KS entropy. 
Thus, 



H<(H KS (B[e))). 



(13) 



4. Estimating the KS entropy and a lower bound of it in maps 

In order to illustrate the performance of our formulas we use the Logistic map [x n+ \ = 
cx n (l — x n )], the Henon map [x n+ \ = a — x\ + by n , and y n+ \ = x n ], and a system of two 
mutually coupled linear maps [x n+ i = 2x n — 2a(y n — x n ) and y n +\ = 2y n — 2a(x n — y n ), 
morf(l)], systems for which Pesin's equality holds. The parameter a in the coupled maps 
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Figure 3. [color online] Results from Eq. ([3]) applied to the FPRs coming from the 
Logistic map (A-B), as we vary the parameter c and ei=0. 00005, and from the Henon 
map (C), as we vary the parameter a and e\ = 0.001. These quantities were estimated 
considering 10 randonmly selected regions. The brown line represents the values of the 
positive Lyapunov exponent. The probability density function p(r, B) was obtained from 
a series of 500.000 FPRs. Green diamonds represent in (A) the values of Hks calculated 
for each one of the 10 randonmly selected regions, in (B) the average value (Hks) an d in 
(C) the minimal value of Hks- 



represents the coupling strength between them, chosen to produce a trajectory with two 
positive Lyapunov exponents. 

Using Eqs. (jSJ) and fl§D to estimate H KS and A furnishes good values if the region B 
where the returns are being measured is not only sufficiently small but also well located 
such that T min is sufficiently large. In such a case the trajectories that produce such a 
short return visit the whole chaotic set [I2H]- For that reason we measure the FPRs for 50 
different regions with a sufficiently small volume dimension, denoted by e^, and use the 
FPRs that produce the largest r m j n , minimizing Hks- Since the lower bound of Hks i n 
Eq. (|S]) is a minimal bound for the KS entropy, the region chosen to calculate it is the one 
for which the lower bound is maximal. This procedure makes Hks an d its lower bound 
(calculated using the FPRs) not to depend on B. 

As pointed out in Ref . [ [T5] , one should consider volume dimensions (also known as 
thresholds) which depend linearly on the size of the attractor [ [2B] , in order to calculate 
the Shannon's entropy. In this work, except for the Henon map, we could calculate well 
Hks, A and a lower bound for Hks from the FPRs and RPs, considering for every system 
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Figure 4. [color online] The same quantities shown in Fig. [3j but now considering only 
the Logistc map, with ei=0.0002 and 500 randonmly selected regions. 



fixed values e\ and 62- For the Henon map, as we increase the parameter b producing 
more chaotic attractors, we increase linearly the size of the volume dimension e 2 within 
the interval [0.002- 0.03]. 

We first compare H KS (see Fig. [Tj), calculated from Eq. in terms of the probabilities 
coming from the FPRs and RPs, in green diamonds and brown stars, respectively, with 
the value of the KS entropy calculated from the sum of the positive Lyapunov exponents, 
represented by the brown straight line. As expected Hks is close to the sum of all the 
positive Lyapunov exponents. When the attractor is a stable periodic orbit we obtain 
that Hks is small if calculated from the RPs. In such a case, we assume that Hks = if 
calculated from the FPRs. This assumption has theoretical grounds, since if the region is 
centered in a stable periodic attractor and ei — > (what can be conceptually make), one 
will clearly obtain that the attractor is periodic. 

The value of the Lyapunov exponent calculated from the formula (JEJ) is represented 
in Fig. [Q by the blue up triangles. As it can be checked in this figure, Eq. (JBJ) holds 
only for ID hyperbolic maps. So, it works quite well for the logistic map (a ID "almost" 
uniformly hyperbolic map) and somehow good for the Henon map. However, it is not 
appropriate to estimate the sum of the positive Lyapunov exponents coming from 2D 
coupled systems. This formula assumes sufficient hyperbolicity and one-dimensionality 
such that e TminX — 1/e. 
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To compare our approach with the method in Ref. [[12], we consider the Henon map 
with a—lA and b = 0.3 for which the positive Lyapunov exponent equals 0.420. Therefore, 
by using Ruelle equality, H KS = 0.420. In Ref. [ 12] it is obtained that the correlation 
entropy K 2 equals 0.325, with H KS > K 2 and in Ref. [Q3] H KS = 0.423. From Eq. ©, 
we obtain H KS = 0.402 and from Eq. we obtain H KS > 0.342, for ei=0.01. 

In Fig. [2tA-C), we show the lower bound estimation of Hks [i n Eq. (jSJ)] in terms of the 
RPs (black circles) and in terms of FPRs (red squares). As expected, both estimations 
follow the tendency of H KS as we increase a. 

Another possible way Eq. d3J) can be used to estimate the value of the KS-entropy is 
by averaging all the values obtained for different intervals, the quantity (Hks) in Eq. (J7J). 
In Fig. [3](A), we show the values of Hks as calculated from Eq. considering a series 
of FPRs with 500.000 returns of trajectories from the Logistic map. For each value of 
the control parameter c, we randomnly pick 10 different intervals with ei=0. 00005. The 
average (H KS ) is shown in Fig. El^B). As one can see, (Hks) is close to the Lyapunov 
exponent A. Notice that from Fig. EtA) one can see that the minimal value of Hks 
(obtained for the largest T min ) approaches well the value of A. 

In order to have a more accurate estimation of the KS-entropy for the Henon map, we 
have used in Figs. [H(B) and^B) a varying e 2 depending on the value of the parameter a, 
exactly as suggested in [ 18], but similar results would be obtained considering a constant 
value. As an example, in Fig. [3]^C) we show the minimal value of Hks considering regions 
with e% = 0.001, for a large range of the control parameter a. 

In order to illustrate how the number of regions as well as the size of the regions alter 
the estimation of the KS-entropy, we show, in Fig. 0](A-C), the same quantities shown in 
Fig. [3](A-B), but now from FPRs exclusively coming from the Logistic map, considering 
500 randonmly selected regions all having sizes ei=0.0002. Recall that in Figs. [Hand EE 
the minimal value of Hks was chosen out of no more than 50 randonmly selected regions. 
Comparing Figs. [3](B) and [1(B) one notices that an increase in the number of selected 
regions is responsible to smooth the curve of (Hks) with respect to c. Concerning the 
minimal value of H K Si the use of intervals with size e\ = 0.0002 provides values close to 
the Lyapunov exponent if this exponent is sufficiently low (what happens for b < 3.7). 
Otherwise, these values deviate when this exponent is larger (what happens for b > 3.7). 
This deviation happens because for these chaotic attractors the size of the chosen interval 
was not sufficiently small [ [28] . 

Notice that the estimated KS entropy deviates from A. See, for example, Figs. E](B) 
and[4](B). One sees two main features in these figures. The first is that for most of the 
simulations, (Hks) > A. The second is that the larger A is, the larger the deviation is. 
The reason for the first feature can be explained by Eqs. (TTTT) and f[T3|) . The reason for 
the second is a consequence of the fact that the larger the Lyapunov exponent is, the 
smaller T min is, and therefore the larger the error in the estimation of the KS entropy. 

To see that our error estimate provides reasonable results, we calculate the quantities 
(Hks) (green diamonds in Fig. [5]), for the Logistic map considering a series of 250.000 
FPRs to L=100 randomly selected regions of size e\ = 0.0002, and the average error E, 
in Eq. (TIT!) [shown in Fig. [5] by the error bars]. The value of the positive Lyapunov 
exponent is shown in the full brown line. 

The error in our estimation is inversely proportional to the shortest return. Had we 



12 



M. S. Baptista 




Figure 5. [color online] Results obtained considering FPRs coming from the Logistic map, 
as we vary the parameter c and ei=0.0002. The probability density function p(r,B) was 
obtained from a series of 250.000 FPRs. Green diamonds represent the values of {Hks) 
calculated for each one of the 100 randomly selected regions. The error bar indicates the 
value of the average error E in Eq. ( JTTT) . These quantities were estimated considering 100 
randomly selected regions. The brown line represents the values of the positive Lyapunov 
exponent. 



considered smaller e regions, T min would be typically larger and as a consequence we 
would obtain a smaller error E in our estimation for the KS entropy. Had we consider a 
larger number of FPRs, the numerically obtained value of r min would be typically slightly 
smaller, making the error E to become slightly larger. So, the reason of why the positive 
Lyapunov exponent in Fig. [5] is located bellow the error bars for the quantity (Hks) 
is a consequence of the fact that we have only observed 250.000 returns, producing an 
overestimation for the value of r m j n . Had we considered a larger number of FPRs would 
make the error E to become slightly larger. 

The considered maps are Ergodic. And therefore, the more (less) intervals used, the 
shorter (the longer) the time series needed in order to calculate the averages from the 
FPR as well as from the RP, as the average (Hks)- 

5. Conclusions 

Concluding, we have shown how to estimate the Kolmogorov- Sinai entropy and a lower 
bound of it using the Poincare First Return Times (FPRs) and the Recurrence Plots. This 
work considers return times in discrete systems. The extension of our ideas to systems 
with a continuous description can be straightforwardly made using the ideas in Ref. [129]. 

We have calculated the expected error in our estimation for the KS entropy and shown 
that this error appears due to the fact that FPRs can only be physically measured consid- 
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ering finite sized regions and only a finite number of FPRs can be measured. This error is 
not caused by any fundamental problems in the proposed Eq. Q . Nevertheless, even for 
when such physical limitations are present, the global estimator of the KS entropy [Eq. 
(Ej)] can be considered as an upper bound for the KS entropy [see Eq. f lTB"]) ]. 
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